Real-time Gesture Mapping in Pd Environment using Neural Networks
نویسندگان
چکیده
In this paper, we describe an adaptive approach to gesture mapping for musical applications. Neural Network abstractions and interfaces are implemented in the Pure Data environment which trains a network automatically and performs a mapping in real-time using trained network parameters. In this paper, we will focus with neural network representations and implementations in a real-time musical environment. This adaptive mapping is evaluated in different static and dynamic situations by a network of sensors sampled at a rate of 200Hz in real-time. Finally, some remarks are given on the network design and future works.
منابع مشابه
Neural Network Performance Analysis for Real Time Hand Gesture Tracking Based on Hu Moment and Hybrid Features
This paper presents a comparison study between the multilayer perceptron (MLP) and radial basis function (RBF) neural networks with supervised learning and back propagation algorithm to track hand gestures. Both networks have two output classes which are hand and face. Skin is detected by a regional based algorithm in the image, and then networks are applied on video sequences frame by frame in...
متن کاملHand Gesture Recognition from RGB-D Data using 2D and 3D Convolutional Neural Networks: a comparative study
Despite considerable enhances in recognizing hand gestures from still images, there are still many challenges in the classification of hand gestures in videos. The latter comes with more challenges, including higher computational complexity and arduous task of representing temporal features. Hand movement dynamics, represented by temporal features, have to be extracted by analyzing the total fr...
متن کاملNyquist Plots Prediction Using Neural Networks in Corrosion Inhibition of Steel by Schiff Base
The corrosion inhibition effect of N,N′-bis(n-Hydroxybenzaldehyde)-1,3-Propandiimine on mild steel has been investigated in 1 M HCl using electrochemical impedance spectroscopy. A predictive model was presented for Nyquist plots using an artificial neural network. The proposed model predicted the imaginary impedance based on the real part of the impedance as a function of time. The model to...
متن کاملReal time gesture recognition using continuous time recurrent neural networks
This paper presents a new approach to the problem of gesture recognition in real time using inexpensive accelerometers. This approach is based on the idea of creating specialized signal predictors for each gesture class. These signal predictors forecast future acceleration values from current ones. The errors between the measured acceleration of a given gesture and the predictors are used for c...
متن کاملSANTIAGO - A Real-Time Biological Neural Network Environment for Generative Music Creation
In this work we present a novel approach for interactive music generation based on the dynamics of biological neural networks. We develop SANTIAGO, a real-time environment built in Pd-Gem, which allows to assemble networks of realistic neuron models and map the activity of individual neurons to sound events (notes) and to modulations of the sound event parameters (duration, pitch, intensity, sp...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004